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(57) An apparatus for restricting a copy of digital 
information (20) is provided with: a detecting device (21 , 
22, 23, 24) for detecting a first watermark, which is bur- 
ied in the digital information and comprises a first signal 
generated on the basis of a first rule; and a burying 
device (25, 26, 27) for burying a second watermark, 
which comprises a second signal generated on the 
basis of a second rule and having a structure different 
from that of the first signal, into the digital information if 
the first watermark is detected by the detecting device. 
A recording apparatus (100) is provided with: an input- 
ting device (10) for inputting the digital information; the 
above mentioned copy restricting apparatus (20); and a 
recording device (50) for recording the digital informa- 
tion in which the second watermark is buried by said 
burying device. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001] The present invention generally relates to a 
method of and an apparatus for restricting a copy or 
duplication of digital information such as digital video 
image etc., and also an apparatus for recording the dig- 
ital information. More particularly, it relates to the 
method of and the apparatus for restricting the copy of 
the digital information and also the apparatus for record- 
ing the digital information, in which a copy generation of 
the digital information is managed by using a water- 
mark. 

2. Description of the Related Art 

[0002] A digital transmission of a video image is 
being generalized by a realization of a digital television 
broadcast. A recording apparatus, which digitally 
records the video image onto an optical disc or mag- 
netic tape, is also being diffused. If the video image can 
be digitally recorded, it is possible to copy or duplicate 
the video image without deterioration of the quality of 
the video image. Therefore, it is necessary to restrict a 
copy of a video image from a view point of a copy right 
and the like. 

[0003] A watermark (i.e., an electronic watermark) 
technique is one of techniques for restricting the copy of 
the video image. The watermark technique is a tech- 
nique for burying or inserting the information related to 
the copy restriction into the digital video image. Herein- 
after, the information related to the copy restriction to be 
buried into the digital information is called as a "water- 
mark". The watermark is buried in the video image so as 
to be hidden in the video image. Thus, even if the water- 
mark is buried, the quality of the video image is hardly 
deteriorated. Since a person, who has received the 
video image in which the watermark is buried, cannot 
recognize even an existence of the watermark in the 
video image, it is very difficult for him or her to remove 
the watermark from the video image. 
[0004] When the digital video image is inputted into 
the recording apparatus, the recording apparatus firstly 
judges whether or not the watermark exists in the video 
image. If the watermark does not exist, the recording 
apparatus judges or determines that the video image is 
copy-allowed, and records the video image onto an opti- 
cal disc for example. On the contrary, if the watermark 
exists, the recording apparatus judges that there is 
some kind of copy restriction for the video image, and 
does not record the video image for example. In this 
manner, it is possible to restrict the copy of the digital 
video image by the existence and absence of the water- 
mark. 

[0005] By the way, in order to solve the problem of 



the copy right while diffusing the digital television broad- 
cast generally, it is necessary not only to allow or pro- 
hibit the copy of the digital video image but also to 
manage a generation of the copy (i.e., the number of 

5 times of the copy). For example, if it is possible to allow 
copying the digital information transmitted from a broad- 
cast station just at a first generation by the recording 
apparatus and to prohibit copying at a second or more 
than second generation (i.e., to allow copying the digital 

10 information only once) for example, the receiver of the 
television broadcast can watch the transmitted video 
image by recording it without being restrained on the 
broadcast time, and at the same time the problem of the 
copy right can be solved. 

15 [0006] In order to realize this kind of generation 
management of the copy of the digital video information 
by use of the aforementioned watermark, it is required 
to prepare one watermark indicating to prohibit copying 
and another watermark indicating to allow copying at a 

20 first generation. Further, it is required to make the 
recording apparatus recognize these two kinds of water- 
marks. Furthermore, it is required to change the water- 
mark when recording the digital video information which 
is copy-allowed only at the first generation, the digital 

25 video image after recording is treated as the digital 
video image which is copy-prohibited or protected. 
[0007] However, it is required to bury the watermark 
into or under the video image so that a person watching 
the video may not notice the existence of the watermark 

30 while restraining the deterioration of the quality of the 
video image. In order to satisfy these requirements, the 
structure of the watermark itself is limited in certain 
degrees. As a result, there is a problem that it is cer- 
tainly difficult to prepare a plurality of kinds of water- 

35 marks and it is also difficult to change the watermark 

SUMMARY OF THE INVENTION 

[0008] It is therefore an object of the present inven- 

40 tion to provide a method of and an apparatus for restrict- 
ing a copy of digital information, and an apparatus for 
recording the digital information, which can appropri- 
ately realize a generation management of a copy of a 
digital video image by using a watermark. 

45 [0009] The above object of the present invention 
can be achieved by a first method of restricting a copy of 
digital information. The first copy restricting method is 
provided with: a detecting process of detecting a first 
watermark, which is buried in the digital information and 

so comprises a first signal generated on the basis of a first 
rule; and a burying process of burying a second water- 
mark, which comprises a second signal generated on 
the basis of a second rule and having a structure differ- 
ent from that of the first signal, into the digital informa- 

55 tion if the first watermark is detected by the detecting 
process. 

[001 0] According to the first copy restricting method 
of the present invention, two kinds of watermarks (i.e., 
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the first and second watermarks) which are different in 
structure from each other are used. For example, by 
correlating these two kinds of watermarks with one 
watermark indicating to prohibit copying and another 
watermark indicating to allow copying at a first genera- 
tion respectively, it is possible to realize a generation 
management for the copy of the digital information. Fur- 
ther, by burying the second watermark into the digital 
information in which the first watermark has been 
already buried, it is possible to change the information 
indicating the watermark. For example, by making the 
first watermark indicate to allow copying at the first gen- 
eration and by making the second watermark indicate to 
prohibit copying, the copy restriction given to the digital 
information can be changed from the first generation 
copy allowance to the copy prohibition. 
[0011] In one aspect of the first copy restricting 
method of the present invention, the burying process 
buries the second watermark by superimposing the 
second watermark onto the digital information in which 
the first watermark is buried. 

[0012] According to this aspect, since the second 
watermark is superimposed onto the digital information 
so as to bury the second watermark, even if additional 
information other than the watermark is included in the 
digital information, it is possible to prevent the additional 
information from being destroyed or erased due to bur- 
ying the second watermark. In this manner, it is possible 
to change the watermark from the first watermark (indi- 
cating to allow copying at the first generation) to the sec- 
ond watermark (indicating to prohibit copying) while 
maintaining the additional information. 
[001 3] In another aspect of the first copy restricting 
method of the present invention, the burying process 
has a generating process of generating the second sig- 
nal by using a generation equation, which is different 
from that used for generating the first signal, to thereby 
bury the second watermark generated by the generat- 
ing process into the digital information. 
[0014] According to this aspect, the second water- 
mark constituted by the second signal, which, is clearly 
different in structure from the first signal, can be rather 
easily generated just by using the generation equation 
different from that used for generating the first signal. 
[0015] Alternatively, in another aspect of the first 
copy restricting method of the present invention, the 
burying process has a generating process of generating 
the second signal by using a generation equation, which 
is same as that used for generating the first signal, and 
by setting an initial value to the generation equation, 
which is different from that set to the generation equa- 
tion for generating the first signal, to thereby bury the 
second watermark generated by the generating process 
into the digital information. 

[0016] According to this aspect, the second water- 
mark constituted by the second signal, which is clearly 
different in structure from the first signal, can be rather 
easily generated by using the generation equation 



same as that used for generating the first signal and just 
by setting the initial value (to the same generation equa- 
tion) different from that set for generating the first signal. 
[0017] In another aspect of the first copy restricting 
5 method of the present invention, the burying process 
has an intensity changing process of changing an inten- 
sity of the second watermark in accordance with a con- 
tent of the digital information, to thereby bury the 
second watermark whose intensity is changed by the 
io intensity changing process into the digital information. 
[0018] According to this aspect, the intensity of the 
second watermark is changed in accordance with the 
content of the digital information by the intensity chang- 
ing process. By this, while restraining the deterioration 
75 of the quality of the digital information due to burying the 
watermark, it is possible to perform a precise detection 
or identification of the watermark. 
[0019] The above object of the present invention 
can be also achieved by a second method of restricting 
20 a copy of digital information. The second copy restrict- 
ing method is provided with: a detecting process of 
detecting a first watermark, which is buried in the digital 
information and comprises a first signal generated on 
the basis of a first rule; and a rewriting process of rewrit- 
es ing the first watermark buried in the digital information 
by a second watermark, which comprises a second sig- 
nal generated on the basis of a second rule and having 
a structure different from that of the first signal if the first 
watermark is detected by the detecting process. 
30 [0020] According to the second copy restricting 
method of the present invention, the information indi- 
cated by the watermark is changed by rewriting the first 
watermark by the second watermark, which is different 
in structure from the first watermark Here, "rewrite the 
first watermark by the second watermark" means to 
remove or erase the first watermark and write the sec- 
ond watermark for example. Therefore, by rewriting the 
watermark, it is possible to further reduce the degree of 
deterioration of the quality of the digital information due 
to burying the watermark. In this manner, it is possible 
to change the watermark from the first watermark to the 
second watermark while restraining the deterioration of 
the quality of the digital information due to burying the 
watermark 

[0021] In one aspect of the second copy restricting 
method of the present invention, the rewriting process 
has a generating process of generating the second sig- 
nal by using a generation equation, which is different 
from that used for generating the first signal, to thereby 
rewrite the first watermark by the second watermark 
generated by the generating process. 
[0022] According to this aspect, the second water- 
mark, which is different in structure from the first water- 
mark, can be rather easily generated just by using the 
generation equation different from that used for generat- 
ing the first signal. 

[0023] Alternatively, in another aspect of the sec- 
ond copy restricting method of the present invention, the 
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rewriting process has a generating process of generat- 
ing the second signal by using a generation equation, 
which is same as that used for generating the first sig- 
nal, and by setting an initial value to the generation 
equation, which is different from that set to the genera- 
tion equation for generating the first signal, to thereby 
rewrite the first watermark by the second watermark 
generated by the generating process. 
[0024] According to this aspect, the second water- 
mark, which is different in structure from the first water- 
mark, can be rather easily generated by using the 
generation equation same as that used for generating 
the first signal and just by setting the initial value differ- 
ent from that set for generating the first signal. 
[0025] In another aspect of the second copy 
restricting method of the present invention, the rewriting 
process has an intensity changing process of changing 
an intensity of the second watermark in accordance 
with a content of the digital information, to thereby 
rewrite the first watermark by the second watermark 
whose intensity is changed by the intensity changing 
process. 

[0026] According to this aspect, the intensity of the 
second watermark is changed in accordance with the 
content of the digital information by the intensity chang- 
ing process. By this, while restraining the deterioration 
of the quality of the digital information due to burying the 
watermark, it is possible to perform a precise detection 
or identification of the watermark. 
[0027] In another aspect of the first or second copy 
restricting method of the present invention, the first 
watermark indicates to allow copying the digital informa- 
tion only at a first generation and the second watermark 
indicates to prohibit copying the digital information. 
[0028] According to this aspect, by correlating the 
first watermark with one watermark indicating to allow 
copying at the first generation and by correlating the 
second watermark with another watermark indicating to 
prohibit copying, it is possible to realize a generation 
management for the copy of the digital information in a 
relatively simple manner. 

[0029] In another aspect of the first or second copy 
restricting method of the present invention, the first sig- 
nal comprises a first PN (Pseudorandom Noise) 
sequence and the second signal comprises a second 
PN sequence which is different from the first PN 
sequence. 

[0030] According to this aspect, the first PN 
sequence may be used as the first signal while the sec- 
ond PN sequence, which is different in structure from 
the first PN sequence, may be used as the second sig- 
nal. Thus, it is possible to rather easily generate the two 
kinds of watermarks which can be identified from each 
other. Further, by constituting the watermark by the PN 
sequence, it is possible to bury the watermark while 
restraining the deterioration of the quality of the digital 
image and keeping the audience unaware of the exist- 
ence of the watermark. 



[0031] In this aspect of the first or second copy 
restricting method of the present invention, the first PN 
sequence and the second PN sequence may be orthog- 
onal to each other. 
5 [0032] According to this aspect, it is possible to 
clearly identify whether the watermark buried in the dig- 
ital information consists of the first PN sequence or the 
second PN sequence. 

[0033] The above object of the present invention 

10 can be also achieved by a first apparatus for restricting 
a copy of digital information. The first copy restricting 
apparatus is provided with: a detecting device for 
detecting a first watermark, which is buried in the digital 
information and comprises a first signal generated on 

75 the basis of a first rule; and a burying device for burying 
a second watermark, which comprises a second signal 
generated on the basis of a second rule and having a 
structure different from that of the first signal, into the 
digital information if the first watermark is detected by 

20 the detecting device. 

[0034] According to the first copy restricting appara- 
tus of the present invention, in the same manner as the 
above described first copy restricting method of the 
present invention, two kinds of watermarks which are 

25 different in structure from each other are used, it is pos- 
sible to realize the generation management for.the copy 
of the digital information, and it is possible to change the 
information indicating the watermark. 
[0035] In one aspect of the first copy restricting 

30 apparatus of the present invention, the burying device 
buries the second watermark by superimposing the 
second watermark onto the digital information in which 
the first watermark is buried. 

[0036] According to this aspect, since the second 

35 watermark is superimposed onto the digital information 
so as to bury the second watermark, even if additional 
information other than the watermark is included in the 
digital information, it is possible to prevent the additional 
information from being destroyed or erased due to bur- 

40 ying the second watermark. 

[0037] In another aspect of the first copy restricting 
apparatus of the present invention, the burying device 
has a generating device for generating the second sig- 
nal by using a generation equation, which is different 

45 from that used for generating the first signal, to thereby 
bury the second watermark generated by the generat- 
ing device into the digital information. 
[0038] According to this aspect, the second water- 
mark constituted by the second signal, which is clearly 

so different in structure from the first signal, can be rather 
easily generated just by using the generation equation 
different from that used for generating the first signal. 
[0039] Alternatively, in another aspect of the first 
copy restricting apparatus of the present invention, the 

55 burying device has a generating device for generating 
the second signal by using a generation equation, which 
is same as that used for generating the first signal, and 
by setting an initial value to the generation equation, 
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which is different from that set to the generation equa- 
tion for generating the first signal, to thereby bury the 
second watermark generated by the generating device 
into the digital information. 

[0040] According to this aspect, the second water- 
mark constituted by the second signal, which is clearly 
different in structure from the first signal, can be rather 
easily generated by using the generation equation 
same as that used for generating the first signal and just 
by setting the initial value different from that set for gen- 
erating the first signal. 

[0041 ] In another aspect of the first copy restricting 
apparatus of the present invention, the burying device 
has an intensity changing device for changing an inten- 
sity of the second watermark in accordance with a con- 
tent of the digital information, to thereby bury the 
second watermark whose intensity is changed by the 
intensity changing device into the. digital information. 
[0042] According to this aspect, the intensity of the 
second watermark is changed in accordance with the 
content of the digital information by the intensity chang- 
ing process. By this, while restraining the deterioration 
of the quality of the digital information due to burying the 
watermark, it is possible to perform a precise detection 
or identification of the watermark. 
[0043] The above object of the present invention 
can be also achieved by a second apparatus of restrict- 
ing a copy of digital information. The second copy 
restricting apparatus is provided with: a detecting 
device for detecting a first watermark, which is buried in 
the digital information and comprises a first signal gen- 
erated on the basis of a first rule; and a rewriting device 
for rewriting the first watermark buried in the digital infor- 
mation by a second watermark, which comprises a sec- 
ond signal generated on the basis of a second rule and 
having a structure different from that of the first signal if 
the first watermark is detected by the detecting device. 
[0044] According to the second copy restricting 
apparatus of the present invention, in the same manner 
as the above described second copy restricting method 
of the present invention, the information indicated by the 
watermark is changed by rewriting the first watermark 
by the second watermark, and it is possible to further 
reduce the degree of deterioration of the quality of the 
digital information due to burying the watermark. 
[0045] In one aspect of the second copy restricting 
apparatus of the present invention, the rewriting device 
has a generating device for generating the second sig- 
nal by using a generation equation, which is different 
from that used for generating the first signal, to thereby 
rewrite the first watermark by the second watermark 
generated by the generating device. 
[0046] According to this aspect, the second water- 
mark constituted by the second signal, which is clearly 
different in structure from the first signal, can be rather 
easily generated just by using the generation equation 
different from that used for generating the first signal. 
[0047] Alternatively, in another aspect of the sec- 



ond copy restricting apparatus of the present invention, 
the rewriting device has a generating device for gener- 
ating the second signal by using a generation equation, 
which is same as that used for generating the first sig- 
5 nal, and by setting an initial value to the generation 
equation, which is different from that set to the genera- 
tion equation for generating the first signal, to thereby 
rewrite the first watermark by the second watermark 
generated by the generating device. 
to [0048] According to this aspect, the second water- 
mark constituted by the second signal, which is clearly 
different in structure from the first signal, can be rather 
easily generated by using the generation equation 
same as that used for generating the first signal and just 
is by setting the initial value different from that set for gen- 
erating the first signal. 

[0049] In another aspect of the second copy 
restricting apparatus of the present invention, the rewrit- 
ing device has an intensity changing device for chang- 
ing an intensity of the second watermark in accordance 
with a content of the digital information, to thereby 
rewrite the first watermark by the second watermark 
whose intensity is changed by the intensity changing 
device. 

[0050] According to this aspect, the intensity of the 
second watermark is changed in accordance with the 
content of the digital information by the intensity chang- 
ing process. By this, while restraining the deterioration 
of the quality of the digital information due to burying the 
watermark, it is possible to perform a precise detection 
or identification of the watermark. 
[0051 ] In another aspect of the first or second copy 
restricting apparatus of the present invention, the first 
watermark indicates to allow copying the digital informa- 
tion only at a first generation and the second watermark 
indicates to prohibit copying the digital information. 
[0052] According to this aspect, by correlating the 
first watermark with one watermark indicating to allow 
copying at the first generation and by correlating the 
second watermark with another watermark indicating to 
prohibit copying, it is possible to realize a generation 
management for the copy of the digital information in a 
relatively simple manner. 

[0053] In another aspect of the first or second copy 
restricting apparatus of the present invention, the first 
signal comprises a first PN sequence and the second 
signal comprises a second PN sequence which is differ- 
ent from the first PN sequence. 

[0054] According to this aspect, the first PN 
sequence may be used as the first signal while the sec- 
ond PN sequence, which is different in structure from 
the first PN sequence, may be used as the second sig- 
nal. 

[0055] In this aspect of the first or second copy 
restricting apparatus of the present invention, the first 
PN sequence and the second PN sequence may be 
orthogonal to each other. 

[0056] According to this aspect, it is possible to 
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clearly identify whether the watermark buried in the dig- 
ital information consists of the first PN sequence or the 
second PN sequence. 

[0057] The above object of the present invention 
can be also achieved by a first apparatus for recording 
digital information. The first recording apparatus is pro- 
vided with: an inputting device for inputting the digital 
information; a detecting device for detecting a first 
watermark, which is buried in the digital information 
inputted by the inputting device and comprises a first 
signal generated on the basis of a first rule; a burying 
device for burying a second watermark, which com- 
prises a second signal generated on the basis of a sec- 
ond rule and having a structure different from that of the 
first signal, into the digital information if the first water- 
mark is detected by the detecting device; and a record- 
ing device for recording the digital information in which 
the second watermark is buried by the burying device. 
[0058] According to the first recording apparatus of 
the present invention, when the first watermark buried in 
the inputted digital information is detected by the detect- 
ing device, the second watermark is buried into the dig- 
ital information in which the first watermark has been 
already buried. Then, the recording device records the 
digital information, in which the second watermark is 
buried, onto a record medium. For example, by correlat- 
ing these two kinds of watermarks with one watermark 
indicating to prohibit copying and another watermark 
indicating to allow copying at a first generation respec- 
tively, it is possible to record the inputted digital informa- 
tion, which is allowed to be copied at the first 
generation, as the digital information which is prohibited 
to be copied, onto the record medium. Namely, when 
recording the digital information, it is possible to change 
the copy restriction given to the digital information from 
the first generation copy allowance to the copy prohibi- 
tion. By this, it is possible to realize a generation man- 
agement for the copy of the digital information. 
[0059] The above object of the present invention 
can be also achieved by a second apparatus for record- 
ing digital information. The second recording apparatus 
is provided with: an inputting device for inputting the dig- 
ital information; a detecting device for detecting a first 
watermark, which is buried in the digital information 
inputted by the inputting device and comprises a first 
signal generated on the basis of a first rule; a rewriting 
device for rewriting the first watermark buried in the dig- 
ital information by a second watermark, which com- 
prises a second signal generated on the basis of a 
second rule and having a structure different from that of 
the first signal if the first watermark is detected by the 
detecting device; and a recording device for recording 
the digital information in which the first watermark is 
rewritten by the second watermark by the rewriting 
device. 

[0060] According to the second recording appara- 
tus, the information indicated by the watermark is 
changed by rewriting the first watermark by the second 



watermark, which is different in structure from the first 
watermark. Therefore, by rewriting the watermark, it is 
possible to further reduce the degree of deterioration of 
the quality of the digital information due to burying the 
5 watermark. In this manner, it is possible to change the 
watermark from the first watermark to the second water- 
mark while restraining the deterioration of the quality of 
the digital information. 

[0061 ] The nature, utility, and further features of this 
io invention will be more clearly apparent from the follow- 
ing detailed description with respect to preferred 
embodiments of the invention when read in conjunction 
with the accompanying drawings briefly described 
below. 

75 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0062] 

20 FIG. 1 is a block diagram showing a condition that 
digital video image transmitted from a television 
broadcast station is received by a video recorder 
etc., according to an embodiment of the present 
invention; 

25 FIG. 2 is a block diagram showing a condition that 
two video recorders are connected to each other 
according to the embodiment of the present inven- 
tion; 

FIG. 3 is a diagram showing an example of burying 
30 a watermark into a picture constituting a digital 
video image in the embodiment of the present 
invention; 

FIG. 4 is a diagram showing a condition that the 
watermark is buried in the picture constituting the 
35 digital video image in the embodiment of the 
present invention; 

FIG. 5 is a block diagram showing a PN sequence 
generation circuit in the embodiment of the present 
invention; 

40 FIG. 6 is a block diagram showing another PN 
sequence generation circuit in the embodiment of 
the present invention; 

FIG. 7 is a block diagram showing a structure of a 
video recorder in the embodiment of the present 
45 invention; 

FIG. 8 is a block diagram showing a process unit of 
the video recorder in the embodiment of the present 
invention; 

FIG. 9 is a diagram showing an example of burying 
so a watermark by superimposing it on a picture in the 
embodiment of the present invention; 
FIG. 10 is a block diagram showing a modified 
example of the process unit of the video recorder in 
the embodiment of the present invention; and 
55 FIG. 1 1 is a diagram showing an example of rewrit- 
ing the watermark in the embodiment of the present 
invention. 
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DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0063] Referring to the accompanying drawings, 
embodiments of the present invention will be now s 
explained. In the embodiments explained below, the 
present invention is applied to a video recorder for 
recording digital video image. 

I. Recording Digital Video Image and Its Copy Restric- 10 
tion 

[0064] First of all, an operation of recording digital 
video image and a restriction of copying the digital video 
image by using a video recorder according to an is 
embodiment of the present invention are explained with 
reference to FIG.1 and FIG. 2. 

[0065] As shown in FIG. 1 , a digital video image is 
transmitted from a television broadcast station 400. For 
example, with respect to the digital video image whose 20 
copy should be restricted from a view point of a copy 
right etc., such as a movie, a watermark (i.e., an elec- 
tronic watermark) is buried or inserted into the digital 
video image at a stage prior to transmitting the digital 
video image from the television broadcast station 400. 25 
[0066] As the watermarks in the present embodi- 
ment, there are one watermark indicating to allow copy- 
ing the digital video image at a first generation and 
another watermark indicating to prohibit copying the 
digital video image. As for the digital video image in 30 
which the watermark indicating to allow copying at the 
first generation is buried, it is allowed to copy only at the 
first generation, but it is not allowed to copy at a second 
or more than second generation. As for the digital video 
image in which the watermark indicating to prohibit cop- 35 
ying, it is not allowed to copy at all regardless of the gen- 
eration. In case that the watermark is not buried in the 
digital video image, it is allowed to freely copy the digital 
video image. 

[0067] Hereinbelow, the watermark indicating to 40 
allow copying the digital video image at a first genera- 
tion (i.e., only once) is simply called as an "OC (One 
Copy) watermark", while the watermark indicating to 
prohibit copying the digital video image is simply called 
as an "NMC (No More Copy) watermark". 45 
[0068] Normally, the OC watermark is buried in the 
digital video image, which is transmitted from the televi- 
sion broadcast station 400. By this, since it is allowed for 
the receiver of the digital video image to record only 
once the transmitted digital video image onto an optical so 
disc 120, it is possible for the receiver to watch the 
transmitted video image by recording it while he or she 
is not restrained on the broadcast time. 
[0069] The digital video image transmitted from the 
television station 400 is received by a set top box 500 ss 
and is sent from the set top box 500 to a video recorder 
100. The video recorder 100 detects that the watermark 
buried in the digital video image is the OC watermark, 



and records the received digital video image onto the 
optical disc 120, for example. At this time, the video 
recorder 100 changes or rewrites the OC watermark to 
the NMC watermark. Namely, after the video recorder 
100 changes the watermark buried in the digital video 
image from the OC watermark to the NMC watermark, 
the video recorder 100 records the digital video image 
onto the optical disc 120. 

[0070] As shown in FIG. 2, the video recorder 1 00 is 
adapted to read out and reproduce the digital video 
image from the optical disc 120 on which the digital 
video image transmitted from the television broadcast 
station 400 is recorded, and to digitally output the digital 
video image toward another video recorder 200 which 
has a same structure as that of the video recorder 100. 
However, since the NMC watermark is buried in the dig- 
ital video image which has been one recorded onto the 
optical disc 120 by the video recorder 100, the video 
recorder 200 cannot record the digital video image onto 
another optical disc 130. Namely, the video recorder 
200 detects that the NMC watermark buried in the dig- 
ital video image, which indicates to prohibit copying, 
and does not record the digital video image onto the 
optical disc 130. In this manner, the copy of the digital 
video image is restricted, and the generation manage- 
ment of copying the digital video image is performed. 

II. Watermark Consisting of PN sequence 

[0071 ] Next, a watermark buried in the digital infor- 
mation is explained with reference to FIG. 3 to FIG. 6. 
[0072] - In the digital video image, information indi- 
cating the brightness or luminance of each picture con- 
stituting the pertinent digital video image is included. 
This information indicating the brightness has a numer- 
ical value of 4 to 8 bits for example, and corresponds to 
each pixel constituting the picture. Namely, the numeri- 
cal value indicating the brightness for each pixel is set 
individually (hereinafter, this numerical value indicating 
the brightness of each pixel is called as a "brightness 
value"). This is explained concretely with reference to 
FIG. 3. A picture P1 in FIG. 3 is one of pictures consti- 
tuting the digital video image. Each of "a", "b", "c", "d", ... 
in the picture P1 indicates the brightness value set for 
respective one of the pixels. 

[0073] The watermark is constituted by a signal or 
signals generated on the basis of a predetermined rule 
e.g., a PN (Pseudorandom Noise) sequence, for exam- 
ple. The PN sequence is a sequence of "1 " and "0" (or 
"+1" and "-1"), which are generated to be pseudo-ran- 
domly arranged. An M sequence (Maximum length 
(shift register) sequence or Maximum Length code) is 
one kind of the PN sequence, which is generated by a 
known M sequence generator. 

[0074] The watermark is buried into the picture by 
adding codes of the PN sequence onto the brightness 
values of the pixels respectively. For example, "0", "0", 
"1", "1", ... in FIG. 3 is the PN sequence constituting the 
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watermark. By adding this PN sequence onto the bright- 
ness values "a", "b", "c", "d", ... in the picture P1, the 
brightness values become "a", 'tf, "c+r\ "d+1", ... in a 
picture P2 as shown in FIG. 4. In this manner, the water- 
mark is buried into each picture constituting the digital 
video image. 

[0075] The PN sequence constituting the water- 
mark is a sequence of pseudorandom codes such as an 
M sequence, and is generated by giving an initial value 
to a polynomial (which is a generation equation) to gen- 
erate the PN sequence. In the present embodiment, the 
polynomial (which is the generation equation) to gener- 
ate the PN sequence is realized as a PN sequence gen- 
eration circuit 1 shown in FIG. 5 for example. The PN 
sequence generation circuit 1 is constituted by shift reg- 
isters 1 A to 1 D and an adder 1 E. 
[0076] In the present embodiment, two kinds of the 
PN sequences different from each other are generated, 
one of which is used for the OC watermark (indicating to 
allow copying the digital information at a first genera- 
tion) and another of which is used for the NMC water- 
mark (indicating to prohibit copying the digital 
information). The arrangement of random codes of the 
PN sequence is changed by changing one or both of the 
polynomial and the initial value. Therefore, by changing 
one or both of the polynomial and the initial value, differ- 
ent kinds of PN sequences can be generated. 
[0077] For example, the PN sequence, which is 
used for the OC watermark, is generated by the PN 
sequence generation circuit 1 shown in FIG. 5. On the 
other hand, the PN sequence, which is used for the 
NMC watermark, is generated by a PN sequence gen- 
eration circuit 2 shown in FIG. 6. The PN sequence gen- 
eration circuit 2 shown in FIG. 6 embodies a polynomial 
(which is a generation. equation) different from the poly- 
nomial (which is a generation equation) corresponding 
to the PN sequence generation circuit 1. The PN 
sequence generation circuit 2 is constituted by shift reg- 
isters 2A to 2D and an adder 2E. The fact that the poly- 
nomial corresponding to the PN sequence generation 
circuit 1 and the polynomial corresponding to the PN 
sequence generation circuit 2 are different from each 
other is clear because the connection of the registers 
and the adder of the PN sequence generation circuit t 
and that of the PN sequence generation circuit 2 are dif- 
ferent from each other. In this manner, by using two PN 
sequence generation circuits whose connections and/or 
structures are different from each other (i.e.. two poly- 
nomials whose structure are different from each other), 
it is possible to generate the OC watermark and the 
NMC watermark. 

[0078] It is also possible to generate both of the OC 
watermark and the NMC watermark by using only the 
PN sequence generation circuit 1 shown in FIG. 5. In 
this case, two kinds of the initial values are prepared 
which are to be given to the PN sequence generation 
circuit 1 . By giving one of those two kinds of the initial 
values to the PN sequence generation circuit 1, the PN 



sequence constituting the OC watermark is generated. 
By giving another of those two kinds of the initial values 
to the PN sequence generation circuit 1, the PN 
sequence constituting the NMC watermark is gener- 

5 ated. For example, in case of generating the PN 
sequence constituting the OC watermark, the initial 
value "001 1" is inputted into the shift register 1 A or 1 D. 
On the other hand, in case of generating the PN 
sequence constituting the NMC watermark, the initial 

w value "01 01 " is inputted into the shift register 1 A or 1 D. 

III. Detection of Watermark 

[0079] Next, the detection of the watermark is 
is explained. As described above, the video recorder 100 
judges whether or not the watermark is buried in the 
digital video image, and also judges whether the water- 
mark indicates to allow copying at the first generation or 
to prohibit copying (i.e., the OC watermark or the NMC 
20 watermark), before recording the received digital video 
image onto the optical disc 120. The video recorder 100 
performs such detection and judgment of the watermark 
by a following method. 

[0080] At first, the PN sequence constituting the OC 
25 watermark is generated. Then, a code whose value is 
"1" is selected from among the codes constituting this 
PN sequence, and a position of this code within the PN 
sequence is identified. Further, the pixel corresponding 
to this position of the code is identified, so that the 
30 brightness value set for this pixel is read out respec- 
tively. For example, in FIG. 3, assuming that the PN 
sequence constituting the OC watermark is "0011...", 
the brightness values "c" and "d" in the picture P1 are 
read out respectively. By performing this kind of process 
35 for a whole picture, a sum value a1 of all the brightness 
values, which have been read out in this manner, is cal- 
culated. 

[0081] Next, a code whose value is TT is selected 
from among the codes constituting the PN sequence 

40 constituting the OC watermark, and a position of this 
code within the PN sequence is identified. Further, the 
pixel corresponding to this position of the code is identi- 
fied, so that the brightness value set for this pixel is read 
out respectively. For example, in FIG. 3. assuming that 

45 the PN sequence constituting the OC watermark is 
"001 1 the brightness values H a n and "b" in the picture 
PI are read out respectively. By performing this kind of 
process for a whole picture, a sum value 01 of all the 
brightness values, which have been read out in this 

so manner, is calculated. 

[0082] Next, a difference between the sum vaJue a1 
and the sum value p1 is calculated. If the OC watermark 
is buried in the picture, the difference between the sum 
values a1 and p 1 becomes a relatively large value. This 

55 is because the sum value of all the brightness values in 
which each brightness value is increased by "1 " by bur- 
ying the OC watermark is the sum value a1 , while the 
sum value of all the brightness values in which each 
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brightness value is not changed at all by burying the OC 
watermark is the sum value p1. On the other hand, in 
case that the watermark is not buried in the picture or in 
case that the NMC watermark is buried in the picture, 
the difference between the sum values a1 and pi 
becomes a relatively small value. Therefore, when the 
difference between the sum values al and pi is equal 
to or larger than a predetermined threshold value, it is 
possible to judge or determine that the OC watermark is 
buried in the picture. 

[0083] Next, the PN sequence constituting the NMC 
watermark is generated. Then, a code whose value is 
"1" is selected from among the codes constituting this 
PN sequence, and a position of this code within the PN 
sequencers identified. Further, the pixel corresponding 
to this position of the code is identified, so that the 
brightness value set for this pixel is read out respec- 
tively. By performing this kind of process for a whole pic- 
ture, a sum value a2 of all the brightness values, which 
have been read out in this manner, is calculated. 
[0084] Next, a code whose value is "0" is selected 
from among the codes constituting the PN sequence 
constituting the NMC watermark, and a position of this 
code within the PN sequence is identified. Further, the 
pixel corresponding to this position of the code is identi- 
fied, so that the brightness value set for this pixel is read 
out respectively. By performing this kind of process for a 
whole picture, a sum value £2 of all the brightness val- 
ues, which have been read out in this manner, is calcu- 
lated. 

[0085] Next, a difference between the sum value a2 
and the sum value p2 is calculated. If the NMC water- 
mark is buried in the picture, the difference between the 
sum values o2 and 02 becomes a relatively large value. 
This is because the sum value of all the brightness val- 
ues in which each brightness value is increased by "1" 
by burying the NMC watermark is the sum value <x2, 
while the sum value of all the brightness values in which 
each brightness value is not changed at all by burying 
the NMC watermark is the sum value p2. On the other 
hand, in case that the watermark is not buried in the pic- 
ture or in case that the OC watermark is buried in the 
picture, the difference between the sum values a2 and 
p2 becomes a relatively small value. Therefore, when 
the difference between the sum values a2 and p2 is 
equal to or larger than a predetermined threshold value, 
it is possible to judge or determine that the NMC water- 
mark is buried in the picture. 

[0086] As a result of the above detection, if the dif- 
ference between the sum values a 1 and p1 is smaller 
than the predetermined threshold value and at the same 
time if the difference between the sum values a2 and p2 
is smaller than the predetermined threshold value, it is 
possible to judge or determine that the watermark is not 
buried in the picture. 

[0087] Incidentally, in the above described detec- 
tion method of the watermark, such a property is utilized 
that the total number of codes each having the value of 



"1 " and the total number of codes each having the value 
of "0" are substantially equal to each other in one 
sequence of the PN sequence. Further, such a fact is 
utilized that, since the codes each having the value of 

5 "1 " and the codes each having the value of "0" are uni- 
formly dispersed in the PN sequence, if the brightness 
values of all the pixels constituting one picture are cate- 
gorized into two groups depending upon whether each 
code in the PN sequence corresponds to 'Tor "0", the 

70 brightness values are uniformly dispersed in each of the 
groups. 

[0088] In the above described detection method of 
the watermark, in order to identify precisely the PN 
sequence constituting the OC watermark and the PN 

15 sequence constituting the NMC watermark, it is prefera- 
ble that the PN sequence constituting the OC water- 
mark and the PN sequence constituting the NMC 
watermark are orthogonal to each other. 
[0089] Here, the "orthogonal" means that a cross 

20 correlation of these two PN sequences becomes sub- 
stantially zero (i.e., a result of integrating a product of 
respective signals of these two PN sequences becomes 
substantially zero). 

[0090] If these two PN sequences are orthogonal to 

25 each other, in case that the brightness values of all the 
pixels constituting the picture in which the PN sequence 
constituting the NMC watermark is categorized into two 
groups on the basis of the PN sequence constituting the 
OC watermark (i.e., categorized depending upon 

30 whether each code in the PN sequence constituting the 
OC watermark corresponds to "1" or "0"), the codes of 
the PN sequence constituting the NMC watermark are 
uniformly dispersed in each group, for example. As a 
result, the difference between the sum values al and pi 

35 becomes a relatively small value. In the same manner, 
in case that the brightness values of all the pixels con- 
stituting the picture in which the PN sequence constitut- 
ing the OC watermark is categorized into two groups on 
the basis of the PN sequence constituting the NMC 

40 watermark (i.e., categorized depending upon whether 
each code in the PN sequence constituting the NMC 
watermark corresponds to "1" or "0"), the codes of the 
PN sequence constituting the OC watermark are uni- 
formly dispersed in each group, for example. As a result, 

45 the difference between the sum values a2 and p2 
becomes a relatively small value. 

IV. Structure and Operation of Video Recorder 

so [0091 ] Next, a concrete structure and an operation 
of the video recorder 100 according to the present 
embodiment will explained with referring to FIG. 7 to 
FIG. 11. 

[0092] At first, a structure of the video recorder 100 
55 is explained. As shown in FIG. 7, the video recorder 100 
is provided with an input unit 10, a process unit 20 and 
a record unit 50. As shown in FIG. 8, the process unit 20 
is provided with a PN sequence generation unit 21 for 
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detecting the watermark, a brightness detection unit 22, 
a sum calculation unit 23, a watermark judgment unit 
24, a PN sequence generation unit 25 for burying the 
watermark, an intensity setting unit 26 and an adder 27. 
Further, the PN sequence generation unit 21 is provided 5 
with the PN sequence generation circuit 1 shown in FIG. 
5 and the PN sequence generation circuit 2 shown in 
FIG. 6. The PN sequence generation unit 25 is provided 
with the PN sequence generation circuit 2 shown in FIG. 
6. The sum calculation unit 23 is provided with two w 
accumulators 23 A and 23 B. 

[0093] Next, the operation of the video recorder 1 00 
is explained. When the digital video image is sent to the 
video recorder 100 from the set top box 500 (refer to 
FIG. 1), the input unit 10 receives the digital video 15 
image as shown in FIG. 7. Then, the input unit 10 out- 
puts this digital video image to the process unit 20 for 
each picture (i.e., for each picture plane) constituting 
this digital video image. 

[0094] When the picture is inputted to the process 20 
unit 20, the PN sequence generation unit 21 , the bright- 
ness detection unit 22, the sum calculation unit 23 and 
the watermark judgment unit 24 shown in FIG. 8 judges 
whether or not the watermark is buried in the picture, 
and judges whether the watermark buried in the picture 25 
indicates to allow copying at the first generation or to 
prohibit copying (i.e., the OC watermark or the NMC 
watermark) by using the above described detection 
method of the watermark. 

[0095] In more detail, at first, the sum calculation 30 
unit 23 initializes the internal values of the accumulators 
23 A and 23B respectively. Then, the PN sequence gen- 
eration unit 21 inputs the predetermined initial value to 
the PN sequence generation circuit 1, so that the PN 
sequence generation circuit 1 generates the PN 35 
sequence constituting the OC watermark. Then, the PN 
sequence generation unit 21 outputs it to the brightness 
detection unit 22. 

[0096] The brightness detection unit 22 receives 
the PN sequence outputted from the PN sequence gen- 40 
eration unit 21, selects the code having the value "1" 
from among the codes constituting this PN sequence, 
and identifies the position of this code within the PN 
sequence. Further, the brightness detection unit 22 
identifies the pixel corresponding to the position of this 45 
code, and reads out the brightness value set for this 
pixel. Then, the brightness detection unit 22 outputs this 
read out brightness value to the sum calculation unit 23. 
The sum calculation unit 23 accumulates the brightness 
values outputted from the brightness detection unit 22 so 
to the first accumulator 23A. 

[0097] The brightness detection unit 22 further 
selects the code having the value "0" from among the 
codes constituting this PN sequence outputted from the 
PN sequence generation unit 21 , and identifies the posi- 55 
tion of this code within the PN sequence. Further, the 
brightness detection unit 22 identifies the pixel corre- 
sponding to the position of this code, and reads out the 



brightness value set for this pixel. Then, the brightness 
detection unit 22 outputs this read out brightness value 
to the sum calculation unit 23. The sum calculation unit 
23 accumulates the brightness values outputted from 
the brightness detection unit 22 to the second accumu- 
lator 23B; 

[0098] After the brightness values of all the pixels 
constituting one picture (i.e., one picture plane) of the 
digital video image are outputted from the brightness 
detection unit 22, the sum calculation unit 23 outputs 
the sum value a1 of the brightness values accumulated 
in the first accumulator 23 A and the sum value pi of the 
brightness values accumulated in the second accumu- 
lator 23B, to the watermark judgment unit 24. After that, 
the sum calculation unit 23 initializes the accumulators 
23A and 23B. 

[0099] The watermark judgment unit 24 calculates 
the difference between the sum value a1 and the sum 
value pi , and judges whether or not the difference is not 
smaller than the predetermined threshold value. If the 
difference is not smaller than the threshold value, the 
watermark judgment unit 24 outputs a control signal 
Sc1 to allow recording the digital video image to the 
record unit 50, and also outputs a control signal Sg, 
which indicates to generate the PN sequence constitut- 
ing the NMC watermark, to the PN sequence genera- 
tion unit 25. 

[0100] On the other hand, if the difference between 
the sum value a1 and the sum value pi is smaller than 
the threshold value, the PN sequence generation unit 
21 inputs the predetermined initial value to the PN 
sequence generation circuit 2, so that the PN sequence 
generation circuit 2 generates the PN sequence consti- 
tuting the NMC watermark. Then, the PN sequence 
generation unit 21 outputs it to the brightness detection 
unit 22. 

[0101] The brightness detection unit 22 receives 
the PN sequence outputted from the PN sequence gen- 
eration unit 21, selects the code having the value "1" 
from among the codes constituting this PN sequence, 
and identifies the position of this code within the PN 
sequence. Further, the brightness detection unit 22 
identifies the pixel corresponding to the position of this 
code, and reads out the brightness value set for this 
pixel. Then, the brightness detection unit 22 outputs this 
read out brightness value to the sum calculation unit 23. 
The sum calculation unit 23 accumulates the brightness 
values outputted from the brightness detection unit 22 
to the first accumulator 23A. 

[0102] The brightness detection unit 22 further 
selects the code having the value "0" from among the 
codes constituting this PN sequence outputted from the 
PN sequence generation unit 21 , and identifies the posi- 
tion of this code within the PN sequence. Further, the 
brightness detection unit 22 identifies the pixel corre- 
sponding to the position of this code, and reads out the 
brightness value set for this pixel. Then, the brightness 
detection unit 22 outputs this read out brightness value 
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to the sum calculation unit 23. The sum calculation unit 

23 accumulates the brightness values outputted from 
the brightness detection unit 22 to the second accumu- 
lator 23B. 

[0103] After the brightness values of all the pixels s 
constituting one picture (i.e., one picture plane) of the 
digital video image are outputted from the brightness 
detection unit 22, the sum calculation unit 23 outputs 
the sum value a2 of the brightness values accumulated 
in the first accumulator 23 A and the sum value (32 of the 10 
brightness values accumulated in the second accumu- 
lator 23 B, to the watermark judgment unit 24. After that, 
the sum calculation unit 23 initializes the accumulators 
23Aand23B. 

[0104] The watermark judgment unit 24 calculates is 
the difference between the sum value a2 and the sum 
value p2, and judges whether or not the difference is not 
smaller than the predetermined threshold value. If the 
difference is not smaller than the threshold value, the 
watermark judgment unit 24 outputs a control signal 20 
Sc2 to prohibit recording the digital video image to the 
record unit 50. At this time, the watermark judgment unit 

24 does not output the control signal Sg to the PN 
sequence generation unit 25. 

[0105] If the difference between the sum value a1 25 
and the sum value p1 which was previously calculated 
is smaller than the threshold value and at the same time 
if the difference between the sum value a2 and the sum 
value p2 which is presently calculated is smaller than 
the threshold value, the watermark judgment unit 24 30 
outputs the control signal Sc1 to allow recording the dig- 
ital video image to the record unit 50. At this time, the 
watermark judgment unit 24 does not output the control 
signal Sg to the PN sequence generation unit 25. 
[0106] Only when the control signal Sg is outputted 35 
from the watermark judgment unit 24, the PN sequence 
generation unit 25 generates the PN sequence consti- 
tuting the NMC watermark by means of the PN 
sequence generation circuit 2. Then, the PN sequence 
generation unit 25 outputs it to the intensity setting unit 40 
26. 

[0107] The intensity setting unit 26 detects the con- 
dition of the image inputted to the process unit 20, and 
changes the intensity of the watermark on the basis of 
the detection result. More concretely, the intensity set- 45 
ting unit 26 detects whether the brightness values set 
for the respective pixels constituting one picture vary in 
a great degree or in a small degree. If the brightness 
values vary in a great degree, since the picture has a 
complicated pattern for example, the watermark is not so 
conspicuous even if the watermark is buried. Therefore, 
when the brightness values vary in a great degree, the 
intensity setting unit 26 applies a process to increase 
the intensity of the watermark onto the PN sequence 
outputted from the PN sequence generation unit 25. For 55 
example, in case that the PN sequence is "0101...", this 
is changed to "0202.. or "0303...". Then, the intensity 
setting unit 26 outputs the watermark (i.e., the PN 



sequence), whose intensity is increased, to the adder 
27. 

[0108] On the other hand, if the brightness values 
vary in a small degree, since the picture is a flat picture 
for example, the watermark is likely conspicuous. 
Therefore, when the brightness values vary in a small 
degree, the intensity setting unit 26 outputs the PN 
sequence outputted from the PN sequence generation 
unit 25 to the adder 27 as it is. 

[01 09] The adder 27 adds the PN sequence output- 
ted from the intensity setting unit 26 and the picture 
inputted to the process unit 20 together. By this, the 
NMC watermark is buried and superimposed on the pic- 
ture, in which the OC watermark has been already bur- 
ied. For example, as shown in FIG. 9, if the PN 
sequence "0101..." constituting the NMC watermark is 
further added onto the picture P2, on which the PN 
sequence "0011..." constituting the OC watermark has 
been already added (refer to FIG. 3 and FIG. 4), the 
brightness values of a picture P3 become "a", "b+1", 
"c+1", "d+2" Then, the adder 27 outputs the pic- 
ture, in which the NMC watermark is newly buried, to 
the record unit 50. 

[0110] On the other hand, when the control signal 
Sg is not outputted from the watermark judgment unit 
24, the generation of the PN sequence is not performed. 
As a result, since no signal is outputted from the PN 
sequence generation circuit 25, no signal is inputted 
into the adder 27. Therefore, the image inputted into the 
process unit 20 is transmitted through the adder 27 as it 
is and is outputted to the record unit 50. 
[01 1 1 ] In this manner, the process unit 20 outputs 
the picture to the record unit 50 as it is when the water- 
mark is not buried in the inputted picture or when the 
NMC watermark is buried in the inputted picture. On the 
other hand, the process unit 20 buries the NMC water- 
mark into the inputted picture by superimposing it on the 
inputted picture and outputs this picture to the record 
unit 50 when the OC watermark has been already bur- 
ied in the inputted picture. 

[0112] The record unit 50 shown in FIG. 7 records 
the picture outputted from the process unit 20 onto the 
optical disc 120 only when the control signal Sc1 to 
allow copying the digital video image is outputted from 
the process unit 20. Namely, the record unit 50 does not 
record the picture (i.e., a video output signal Sp) output- 
ted from the process unit 20 onto the optical disc 120 
when the control signal Sc2 to prohibit copying the dig- 
ital video image is outputted from the process unit 20. 
As a result, the record unit 50 records the picture out- 
putted from the process unit 20 onto the optical disc 1 20 
if the watermark is not buried in the picture inputted to 
the process unit 20 or when the OC watermark is buried 
in the image inputted to the process unit 20. On the 
other hand, the record unit 50 does not record the pic- 
ture outputted from the process unit 20 onto the optical 
disc 120 if the NMC watermark has been already buried 
in the picture inputted to the process unit 20. 



21 



EP 1 006 722 A2 



22 



[0113] In this manner, according to the video 
recorder 100 of the present embodiment, it is possible 
to identify whether the copy restriction given to the dig- 
ital video image is to allow copying the digital informa- 
tion at the first generation or to prohibit copying the 5 
digital information, by use of the OC and NMC water- 
marks consisting of the two kinds of PN sequences dif- 
ferent from each other. Further, in case that the 
watermark buried in the digital video image indicates to 
allow copying at the first generation, it is possible to ro 
change the copy restriction given to the digital video 
image from the first generation copy allowance to the 
copy prohibition, by burying the NMC watermark into 
the digital video image. By this, the basic requirements 
required for the watermark i.e., ® to restrain the deteri- 1S 
oration of the quality of the video image © not to have 
the audience watching the video image be aware of the 
existence of the watermark and ® to realize the copy 
restriction easily and at a low cost, are fulfilled. At the 
same time, it is possible to realize the identification 20 
between the first generation copy allowance and the 
copy prohibition and also realize the change from the 
first generation copy allowance to the copy prohibition. 
Therefore, the generation management of the copy of 
the digital video image can be realized optimally. 2 5 
[01 14] Further, according to the video recorder 100 
of the present embodiment, by burying the NMC water- 
mark in the digital video image in which the OC water- 
mark has been already buried, it is possible to change 
the copy restriction for the digital video image from the 30 
first generation copy allowance to the copy prohibition 
while maintaining the additional information other than 
the watermark buried in the digital video image. 
[0115] For example, there is a case that the digital 
video image carries and hides the additional information 35 
related to the video image (e.g., information related to 
the content of the video image such as a movie, a 
drama, a sport broadcast) in the substantially same 
manner as the watermark. In such a case, if the bright- 
ness values of the picture are rewritten, there is a possi- 40 
bility that the additional information may be destroyed or 
erased. However, according to the video recorder 100 of 
the present embodiment, since the NMC watermark is 
merely added onto the brightness values of the picture 
as shown in FIG. 9, the additional information is not 45 
destroyed or erased. 

[011 6] Further, according to the video recorder 100 
of the present embodiment, it is possible to easily gen- 
erate the watermark consisting of the second PN 
sequence, which is distinctively different in structure so 
from the first PN sequence, by generating the NMC 
watermark and the OC watermark by use of the PN 
sequence generation circuits 1 and 2 corresponding to 
the two kinds of polynomials different from each other, 
respectively. By this, it is possible to improve the distinc- ss 
tion in identifying the OC watermark and the NMC 
watermark from each other. 

[0117] Furthermore, according to the video 



recorder 100 of the present embodiment, by changing 
the intensity of the watermark which is to be buried in 
the digital video image in correspondence with the con- 
tent of the picture, it is possible to precisely detect or 
identify the watermark while restraining the deteriora- 
tion of the quality of the digital information due to bury- 
ing the watermark. As the PN sequence constituting the 
NMC watermark and the PN sequence constituting the 
OC watermark have the orthogonal relationship with 
each other, it is possible to distinctly identify whether the 
watermark buried in the digital information is the OC 
watermark or the NMC watermark. 
[01 1 8] In the above described process unit 20 in the 
video recorder 100, the NMC watermark is buried into 
the digital video image, in which the OC watermark has 
been already buried, by superimposing it on the digital 
video image. However, the present invention is not lim- 
ited to this. For example, it is possible to rewrite the 
watermark buried in the digital video image from the OC 
watermark to the NMC watermark. 
[0119] In this case, the process unit of the video 
recorder is constructed as shown in FIG. 10, for exam- 
ple. Namely, a process unit 40 in FIG. 10 has a structure 
nearly same as the process unit 20 in FIG. 8 except for 
the PN sequence generation unit 45 for burying the 
watermark. The PN sequence generation unit 45 of the 
process unit 40 is provided with the PN sequence gen- 
eration circuit 1 for generating the PN sequence consti- 
tuting the OC watermark, the PN sequence generation 
circuit 2 for generating the PN sequence constituting the 
NMC watermark, and a subtraction circuit 3 for subtract- 
ing the PN sequence generated by the PN sequence 
generation circuit 1 from the PN sequence generated by 
the PN sequence generation circuit 2. 
[0120] The operation of the PN sequence genera- 
tion unit 45 is more concretely explained here. When 
the control signal Sg is outputted from the watermark 
judgment unit 24, the PN sequence generation unit 45 
generates the PN sequence "0101..." constituting the 
NMC watermark by virtue of the PN sequence genera- 
tion circuit 2 for example. Then, the PN sequence gen- 
eration unit 45 generates the PN sequence "0011..." 
constituting the OC watermark by virtue of the PN 
sequence generation circuit 1 for example. Further, the 
PN sequence generation unit 45 generates the PN 
sequence "01-10..." by subtracting the PN sequence 
"0011..." constituting the OC watermark from the PN 
sequence "0101..." constituting the NMC watermark by 
virtue of the subtraction circuit 3. Then, the PN 
sequence generation unit 45 outputs it to the intensity 
setting unit 26. The PN sequence "01-10..." outputted 
from the PN sequence generation unit 45 is changed in 
its intensity as the occasion demands by the intensity 
setting unit 26, and is then added onto the brightness 
values of the picture inputted to the process unit 40, by 
the adder 27 as shown in FIG. 1 1 . 
[0121] As a result, the OC watermark buried in the 
picture is removed from the picture, and the NMC water- 
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mark is buried in the picture. According to the video 
recorder having such a structure, it is possible to rewrite 
the watermark buried in the picture from the OC water- 
mark to the NMC watermark. Since the watermark is 
rewritten, it is possible to decrease the degree of the 
change in the brightness values by burying the water- 
mark. Therefore, while restraining the deterioration of 
the quality of the digital information, it is possible to 
change the watermark from the OC watermark to the 
NMC watermark. 

[0122] . In the above described embodiments, 
although the PN sequence constituting the watermark is 
added onto the brightness values set for respective pix- 
els of the picture, the present invention is not limited to 
this. For example, the PN sequence constituting the 
watermark may be added onto the other values set for 
respective pixels. 

[0123] The PN sequence constituting the water- 
mark is not limited to the M sequence. For example, 
other random sequence such as a Gold code may be 
employed as the PN sequence constituting the water- 
mark. 

[0124] In the above described embodiments, a 
case has been explained in which the watermark is con- 
stituted by the PN sequence. However, the present 
invention is not limited to this. For example, it is possible 
to constitute the watermark by another signal, in which 
random or nearly random codes are arranged or codes, 
whose arrangement is disciplined but whose disciplined 
manner cannot be easily recognized, are arranged. 
[0125] Furthermore, in the above described 
embodiment, a case has been explained in which the 
code constituting the PN sequence and the pixel of the 
picture are one-to-one correspondent with each other. 
However, the present invention is not limited to this. For 
example, the picture (i.e., the picture plane) may be 
divided into a plurality of areas each consists of a plural- 
ity of pixels adjacent to each other, so that this area and 
the code constituting the PN sequence may be one-to- 
one correspondent with each other. Here, an example is 
explained in which the PN sequence "01 01..." constitut- 
ing the NMC watermark is buried into the picture, which 
is divided into square areas each consisting of 4 pixels 
adjacent to each other. In this example, "0" is added 
onto all the brightness values of the 4 pixels included in 
the area disposed at the first in the image. Further, "1" 
is added onto all the brightness values of the 4 pixels 
included in the area disposed at the second in the 
image. In this manner, by making the codes constituting 
the PN sequence and the areas consisting of a plurality 
of pixels one-to-one correspondent with each other, the 
watermark can remain in the digital video image even if 
the digital video image is filtered or compressed. 
[0126] Moreover, in the above described embodi- 
ment, a case has been explained in which the present 
invention is applied to the video recorder for recording 
the digital video image. However, the present invention 
is not limited to this. For example, the present invention 



can be applied to a recording apparatus for recording 
the digital audio sound. 

Claims 

5 - 

1 . A method of restricting a copy of digital information, 
characterized in that said method comprises: 

a detecting process of detecting a first water- 
io mark, which is buried in the digital information 

and comprises a first signal generated on the 
basis of a first rule; and 
a burying process of burying a second water- 
mark, which comprises a second signal gener- 
is ated on the basis of a second rule and having a 

structure different from that of the first signal, 
into the digital information if the first watermark 
is detected by the detecting process. 

2. A method according to claim 1, characterized in 
that said burying process buries the second water- 
mark by superimposing the second watermark onto 
the digital information in which the first watermark is 
buried. 

3. A method according to claim 1 or 2, characterized 
in that said burying process comprises a generating 
process of generating the second signal by using a 
generation equation, which is different from that 
used for generating the first signal, to thereby bury 
the second watermark generated by said generat- 
ing process into the digital information. 

4. A method according to claim 1 or 2, characterized 
in that said burying process comprises a generating 
process of generating the second signal by using a 
generation equation, which is same as that used for 
generating the first signal, and by setting an initial 
value to the generation equation, which is different 
from that set to the generation equation for generat- 
ing the first signal, to thereby bury the second 
watermark generated by said generating process 
into the digital information. 

5. A method according to any one of claims 1 to 4, 
characterized in that said burying process com- 
prises an intensity changing process of changing 
an intensity of the second watermark in accordance 
with a content of the digital information, to thereby 
bury the second watermark whose intensity is 
changed by said intensity changing process into the 
digital information. 

6. A method of restricting a copy of digital information, 
characterized in that said method comprises: 

a detecting process of detecting a first water- 
mark, which is buried in the digital information 



25 



30 



35 



40 



45 



50 



13 



25 



EP 1 006 722 A2 



26 



and comprises a first signal generated on the 
basis of a first rule; and 
a rewriting process of rewriting the first water- 
mark buried in the digital information by a sec- 
ond watermark, which comprises a second 
signal generated on the basis of a second rule 
and having a structure different from that of the 
first signal if the first watermark is detected by 
the detecting process. 

7. A method according to claim 6, characterized in 
that said rewriting process comprises a generating 
process of generating the second signal by using a 
generation equation, which is different from that 
used for generating the first signal, to thereby 
rewrite the first watermark by the second water- 
mark generated by said generating process. 

8. A method according to claim 6, characterized in 
that said rewriting process comprises a generating 
process of generating the second signal by using a 
generation equation, which is same as that used for 
generating the first signal, and by setting an initial 
value to the generation equation, which is different 
from that set to the generation equation for generat- 
ing the first signal, to thereby rewrite the first water- 
mark by the second watermark generated by said 
generating process. 

9. A method according to any one of claims 6 to 8, 
characterized in that the rewriting process com- 
prises an intensity changing process of changing 
an intensity of the second watermark in accordance 
with a content of the digital information, to thereby 
rewrite the first watermark by the second water- 
mark whose intensity is changed by said intensity 
changing process. 

10. A method according to any one of claims 1 to 9, 
characterized in that 

the first watermark indicates to allow copying 
the digital information only at a first generation 
and 

the second watermark indicates to prohibit 
copying the digital information. 

11. A method according to any one of claims 1 to 10, 
characterized in that 

the first signal comprises a first PN sequence 
and 

the second signal comprises a second PN 
sequence which is different from the first PN 
sequence. 

12. A method according to claim 11, characterized in 
that 



the first PN sequence and the second PN 
sequence are orthogonal to each other. 

13. An apparatus for restricting a copy of digital infor- 
5 mation (20), characterized in that said apparatus 

comprises: 

a detecting device (21 , 22, 23, 24) for detecting 
a first watermark, which is buried in the digital 

10 information and comprises a first signal gener- 

ated on the basis of a first rule; and 
a burying device (25, 26, 27) for burying a sec- 
ond watermark, which comprises a second sig- 
nal generated on the basis of a second rule and 

is having a structure different from that of the first 

signal, into the digital information if the first 
watermark is detected by the detecting device. 

14. An apparatus (20) according to claim 13, character- 
ise ized in that said burying device (25, 26, 27) buries 

the second watermark by superimposing the sec- 
ond watermark onto the digital information in which 
the first watermark is buried. 

25 15. An apparatus (20) according to claim 13 or 14, 
characterized in that said burying device (25, 26, 
27) comprises a generating device (25) for generat- 
ing the second signal by using a generation equa- 
tion, which is different from that used for generating 

30 the first signal, to thereby bury the second water- 
mark generated by said generating device into the 
digital information. 

16. An apparatus (20) according to claim 13 or 14, 
35 characterized in that said burying device (25, 26, 

27) comprises a generating device (25) for generat- 
ing the second signal by using a generation equa- 
tion, which is same as that used for generating the 
first signal, and by setting an initial value to the gen- 
40 eration equation, which is different from that set to 
the generation equation for generating the first sig- 
nal, to thereby bury the second watermark gener- 
ated by said generating device into the digital 
information. 

45 

17. An apparatus (20) according to claim 13 to 16. 
characterized in that said burying device (25, 26, 
27) comprises an intensity changing device (26) for 
changing an intensity of the second watermark in 

so accordance with a content of the digital information, 
to thereby bury the second watermark whose inten- 
sity is changed by said intensity changing device 
into the digital information. 

55 1 8. An apparatus of restricting a copy of digital informa- 
tion (40), characterized in that said apparatus com- 
prises: 
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a detecting device (21 , 22, 23, 24) for detecting 
a first watermark, which is buried in the digital 
information and comprises a first signal gener- 
ated on the basis of a first rule; and 
a rewriting device (45, 26, 27) for rewriting the 
first watermark buried in the digital information 
by a second watermark, which comprises a 
second signal generated on the basis of a sec- 
ond rule and having a structure different from 
that of the first signal if the first watermark is 
detected by the detecting device. 

1 9. An apparatus (40) according to claim 18, character- 
ized in that said rewriting device (45, 26, 27) com- 
prises a generating device (45) for generating the 
second signal by using a generation equation, 
which is different from that used for generating the 
first signal, to thereby rewrite the first watermark by 
the second watermark generated by said generat- 
ing device. 

20. An apparatus (40) according to claim 18, character- 
ized in that said rewriting device (45, 26, 27) com- 
prises a generating device (45) for generating the 
second signal by using a generation equation, 
which is same as that used for generating the first 
signal, and by setting an initial value to the genera- 
tion equation, which is different from that set to the 
generation equation for generating the first signal, 
to thereby rewrite the first watermark by the second 
watermark generated by said generating device. 

21 . An apparatus (40) according to any on of claims 1 8 
to 20, characterized in that the rewriting device (45, 
26, 27) comprises an intensity changing device (26) 
for changing an intensity of the second watermark 
in accordance with a content of the digital informa- 
tion, to thereby rewrite the first watermark by the 
second watermark whose intensity is changed by 
said intensity changing device. 

22. An apparatus (20, 40) according to any one of 
claims 1 3 to 21 , characterized in that 

the first watermark indicates to allow copying 
the digital information only at a first generation 
and 

the second watermark indicates to prohibit 
copying the digital information. 

23. An apparatus (20, 40) according to any one of 
claims 13 to 22, characterized in that 

the first signal comprises a first PN sequence 
and 

the second signal comprises a second PN 
sequence which is different from the first PN 
sequence. 



24. An apparatus (20, 40) according to claim 23, char- 
acterized in that 

the first PN sequence and the second PN 
5 sequence are orthogonal to each other. 

25. An apparatus for recording digital information (100), 
characterized in that said apparatus comprises: 

io an inputting device (10) for inputting the digital 

information; 

a detecting device (20) for detecting a first 
watermark, which is buried in the digital infor- 
mation inputted by said inputting device and 
15 comprises a first signal generated on the basis 

of a first rule; 

a burying device (20) for burying a second 
watermark which comprises a second signal 
generated on the basis of a second rule and 
having a structure different from that of the first 
signal, into the digital information if the first 
watermark is detected by the detecting device; 
and 

a recording device (50) for recording the digital 
information in which the second watermark is 
buried by said burying device. 

26. An apparatus for recording digital information (100), 
characterized in that said apparatus comprises: 

an inputting device (10) for inputting the digital 
information; 

a detecting device (40) for detecting a first 
watermark, which is buried in the digital infor- 
mation inputted by said inputting device and 
comprises a first signal generated on the basis 
of a first rule; 

a rewriting device (40) for rewriting the first 
watermark buried in the digital information by a 
second watermark, which comprises a second 
signal generated on the basis of a second rule 
and having a structure different from that of the 
first signal if the first watermark is detected by 
the detecting device; and 
a recording device (50) for recording the digital 
information in which the first watermark is 
rewritten by the second watermark by said 
rewriting device. 
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